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Abstract. - We solve the g-state Potts model with anti-ferromagnetic interactions on large random 
lattices of finite coordination. Due to the frustration induced by the large loops and to the local 
tree-like structure of the lattice this model behaves as a mean field spin glass. We use the cavity 
method to compute the temperature-coordination phase diagram and to determine the location of 
the dynamic and static glass transitions, and of the Gardner instability. We show that for q > 4 
the model possesses a phenomenology similar to the one observed in structural glasses. We also 
illustrate the links between the positive and the zero-temperature cavity approaches, and discuss 
the consequences for the coloring of random graphs. In particular we argue that in the colorable 
region the one-step replica symmetry breaking solution is stable towards more steps of replica 
symmetry breaking. 
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There are mainly two types of lattices for which the 
mean field theory of spin glasses is exact. The first type 
ife the fully connected lattice underlying the canonical 
Sherrington-Kirkpatrick model [1]. Parisi introduced the 
I'eplica symmetry breaking (RSB) scheme [2] to obtain a 
solution of this model that was much later proven to be 
I'igorously exact [3]. Similar solutions have been derived 
for the p-spin model [4] and for the Potts glass model [5] , 
dnd these played a major role in the development of the 
mean field theory of the structural glass transition [6,7]. 
[ The second type of lattice for which the mean field the- 
ory is exact is given by large random graph with fixed 
average degree (or connectivity), a case commonly ref- 
ereed to as "Bethe lattice" in the physics literature [8]. 
These lattices are considered as more realistic since the no- 
tions of distance and neighboring can be naturally defined. 
Few years ago, Mezard and Parisi [9,10], using the cav- 
ity method, have adapted the replica symmetry breaking 
scheme to solve models on such sparse lattices. The the- 
oretical activity following this breakthrough was mainly 
concentrated on the zero temperature limit [10] of various 
models on random graphs, motivated by the equivalence 
with the random cases of hard combinatorial optimiza- 
tion problems such as graphs coloring or the satisfiability 
of boolean formulae [11]. The last few years have indeed 
witnessed spectacular successes in this direction [11]. 
In this paper, we consider a g-statc Potts model with 



anti-ferromagnetic nearest neighbors interactions on ran- 
dom graphs. Due to the frustration induced by large loops 
and to the locally tree-like structure of the graph, the 
model actually behaves as a mean field spin glass. Using 
the cavity approach, we study systematically the phase di- 
agram for different temperatures T, average connectivities 
c, and number of states (colors) q. Determining the differ- 
ent phases, and which step of replica symmetry breaking 
is needed for given T, c, q are the main contributions of 
this work. The zero temperature limit of this model maps 
to the g-coloring problem, and has been studied exten- 
sively [12-18], while the positive temperature studies are 
hmited to [13, 16, 18]. Our results give a generic picture 
of Potts glasses on sparse random graphs, and have inter- 
esting consequences for constraint satisfaction problems 
as well. Finally, we also discuss the subtle connections 
between the positive [9] and zero temperature [10] cavity 
formalisms, and correct some confusions that have been 
made in the literature in the use of these two approaches. 

Anti-ferromagnetic Potts glass. We consider a 

g-state anti-ferromagnetic Potts model. Given a graph 
G = (V,£) defined by its vertices V = {1, N} and edges 
{i,j) G £ the Hamiltonian reads 



(1) 
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where a = 1 , . . . , g are the values of the different Potts 
spins. On a bipartite graph (like a d-dimensional lat- 
tice), the ground-state is anti-ferromagnetically ordered. 
On large random graphs, however, the frustration induced 
by the large loops does not allow the anti-ferromagnetic 
order and a glassy solution appears instead. 

We will consider two ensembles of sparse random 
graphs: the Erdos-Rcnyi (ER) graphs with Poissonian de- 
gree distribution of mean c, and the regular graphs with 
fixed degree c. Both are locally tree-like in the thermody- 
namic limit so that the length of the shortest loop going 
through a random vertex diverges as log TV when N oo 
(our results generalize to other locally tree-like ensembles) . 

It is interesting to discuss the relation of the model de- 
fined by the Hamiltonian (1) with the one defined by the 
following disordered Hamiltonian 
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(2) 



where iTij represents a random permutation of the q col- 
ors. In this disordered anti-ferromagnetic Potts model, 
the anti-ferromagnetic order is explicitly destroyed by the 
disorder independently of the lattice. Notice that a differ- 
ent disordered Potts model was defined originally [5, 19] 
but the advantage of our definition (2) is that due to the 
existence of a gauge symmetry, the total equilibrium mag- 
netization is zero at all temperatures, independently of 
the lattice. Indeed, if we change the color of an arbitrary 
spin i, then there always exists an energy conserving gauge 
transformation of the interactions between spin i and its 
neighbors such that the probability of the new set of inter- 
actions is the same as of the original one. After averaging 
over disorder the magnetization is zero, and self-averaging 
implies that it is also zero on a single large system. The 
model defined by (2) is thus convenient for numerical sim- 
ulations of the glassy phase, even on regular finite dimen- 
sional lattices. Note that a ferromagnetic version of (2) 
was already defined and studied in [20] . 

The two models defined by (1) and (2) share the same 
solution on sparse random lattices. Indeed, by the gauge 
transformation, the two models can be made equivalent 
on a large tree-like neighborhood of a vertex, the differ- 
ence being pushed on the boundary of this neighborhood. 
Inside a pure state the boundary conditions caused by the 
rest of the graph are uncorrelated and color symmetric 
(a color asymmetric, ordered, solution is ruled out by the 
frustrating long loops), thus a point- wise random permu- 
tation does not change their statistical properties and the 
same solution is obtained for both the models. We actu- 
ally use this equivalence to resolve the numerical instabil- 
ity towards the anti-ferromagnetic solution in the cavity 
iterative equations for the model (1) by randomly permut- 
ing the colors after each iteration, which is exactly what 
the Hamiltonian (2) would do. 

Cavity methodology reminder. The cavity 
method [9] allows to solve models (1,2) on large sparse 



random graphs. The results are expected to be exact (al- 
though a rigorous proof is still missing) provided that the 
correct level of replica symmetry breaking is considered. 
A detailed derivation of the equations for Hamiltonian (1) 
is presented in [18], we discuss only the parts necessary 
for the presentation of our results. 

The liquid phase. The high-temperature liquid, or 
paramagnetic, phase is characterized by an exponential 
decay of correlation functions and is associated with the 
existence of a single pure state. The simplest version of the 
cavity method, called replica symmetric (RS), describes 
correctly this phase [13, 18]. A first, simple, way to check 
the appearance of a spin glass phase is to compute the 
temperature where the spin-glass susceptibility diverges, 
or equivalently where the RS cavity equations do not con- 
verge on a single graph or, in other words, where the RS 
solution is locally unstable. When this happens, a continu- 
ous phase transition towards a spin glass phase arises. The 
temperature of the local RS instability is given by [18] 



71ocal('?, c) = -1/ln 1 - 



V^ + 1 



(3) 



where k ~ c for ER graph, and c — 1 for regular graphs. 

It is however common to observe the discontinuous ap- 
pearance of a spin glass solution before the local instability 
sets in. In order to check this point, it has been argued 
recently [16,21] that the decay of the so-called point-to-set 
correlations provides a necessary and sufficient condition 
for the validity of the RS solution. When the temperature 
is lowered, a dynamical temperature Td might be reached 
below which the point-to-set correlation does not decay to 
zero and the system undergoes a dynamical phase transi- 
tion, as the equilibration time of "local flip" Monte-Carlo 
dynamics diverges [21]. As shown in [16], this correlation 
does not decay to zero if and only if it exists a non-trivial 
solution to the one-step replica symmetry breaking equa- 
tion when the so-called Parisi parameter m = 1 (see be- 
low) . Below Td the RS pure state splits into exponentially 
many disconnected pure states. 

The glass phase with many states. The one-step 
replica symmetry breaking (IRSB) cavity method deals 
with this situation. It allows to compute the complex- 
ity S(/) defined as the logarithm of the number of pure 
states of internal free energy density /. In order to do so, 
we follow [22] and define a potential ^{(3,m) as 



-f3mN<S>{f3,m) 



(4) 



where the sum is over all states a, and m = dfY,{f)/(3 a 
temperature-like parameter in the Legendre transform [9, 
22] . In the closely related replica formalism, the parameter 
m defines the block size of Parisi's overlap matrix [2]. 

For regular graphs $(/3, m) can be computed from the 
fixed point of the IRSB equation 

= rf / di''P{^^)5\i;-T{{^''}) \ (Zo)™, (5) 



k=l 
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Fig. 1: A set of m-T diagrams for the g-state anti- ferromagnetic Potts model on c-regular random graphs: a non-trivial solution 
of eq. (5) exists in the shaded region. The curves with diamond data points ?n*(T) (red online) represent the thermodynamic 
value of the parameter m. The darker region, delimited with crosses (blue online) is type II unstable towards further steps of 
replica symmetry breaking. The dotted lines (absent in (d)) represent the type I instability mi{T) calculated analytically close 
to T = 0, IRSB is type I unstable for m > mi{T). Td, Tk, Tq and Tiocai are the dynamical, Kauzmann, Gardner and local 
temperature (respectively), (a) is an example of continuous (Sherrington-Kirkpatrick-like) transition towards more than one 
step of RSB; (b) is an example of continuous transition to the IRSB phase, with a Gardner transition at lower temperatures; 
(c) is a discontinuous transition in the uncolorable phase and (d) is a discontinuous transition in the colorable phase. 



where P{ip) is the unknown probabiUty distribution of q- 
component normalized vectors Zi a, normalization, and 
the function J- is defined component-wise as 

i^r = Trim) = Y n [1 - (1 - e"") ' 
" k=l 

where r = 1 . . . Zq is a normalization constant and each 
component of the vector -0 is the probability that a node, 
in absence of one of its neighbors, takes the corresponding 
color [9]. For graphs with fluctuating degree eq. (5) has to 
be written edge-dependently and an average over the edges 
of the graph has to be performed [9, 18]. In both cases, 
eq. (5) can be solved numerically using the population 
dynamics method [9] where the probability distribution 
P[ip) is represented by a population of many elements -0. 
At m = 1, a formal substitution introduced in [16] (see 
also [18]) allows to rewrite the averaging of eq. (5) in a 
simple way for the fluctuating connectivity graphs as well. 

The two-temperatures diagram. The temper- 
ature T (resp. temperature-like parameter m) in (5) is 
related to the energy {resp. size) of the states. It is thus 
convenient to consider the solution of eq. (5) in the m — T 
diagram. This representation moreover clarifies the con- 
nection of the positive temperature approach with the dif- 
ferent zero-temperature limits of [12,14] and [15,18]. We 
plot several such diagrams in fig. 1. The region where 
a non-trivial (different from the RS one) solution of (5) 
exists is shaded in light and darker grey. At m = 1 a 
non-trivial solutions exists for all T < T^. At m = the 
absence of the re-weighting term makes the solution 
of (5) be non-trivial if the RS equations do not converge 
on a single graph, i.e., for all T < Tiocai- 

The next step is the computation of the thermodynamic 
value of the parameter m*(T). The free energy in the 



IRSB phase reads 

-/3/iRSB = ^ max [-/3/ + !](/)] . (7) 

Call / the free energy for which 9/E(/) = /3 (so that m = 
1, seeeq. (4)). If E(/) > then -/3/irsb = -/3/ + S(/) = 
— /3$(/3, 1) = — /3/rs and the free energy is equal to the RS 
one. This explains the importance of the value m = 1: as 
long as the complexity I](m = 1) > 0, then m* = 1. If 
I](m = 1) < 0, however, the pure states corresponding 
to the free energy / are almost surely absent in the large 
size limit and to maximize eq. (7) we choose instead /* 
such that !](/*) = 0. Consequently fmsB = /* > hs 
and a genuine phase transition happens at the so-called 
Kauzmann temperature Tk where I](m = 1) = 0. 

Between Td and Tk the thermodynamics is dominated 
by an exponential number of states and the total free en- 
ergy is equal to liquid one, so that the dynamical transi- 
tion is not a true transition in the Ehrenfest sense. Below 
the Kauzmann temperature the thermodynamics is domi- 
nated only by a finite number of them (although exponen- 
tially many states still exist, they are thermodynamically 
negligible). At T = Tk, the free energy has a discontinu- 
ity in its second derivative, i.e., in the specific heat. This 
phenomenon, first hypothesized by Kauzmann, is called 
the ideal glass transition. 

Zero temperature limit. The g-state anti- 

ferromagnetic Potts model maps to a fundamental 
problem of graph theory: if the ground state energy 
is zero, the graph is colorable by q colors so that 
neighboring spins have different colors, otherwise the 
graph is g-uncolorable. This has been studied in great 
detail in [12-18]. An important relation is that if 
m*(T = 0) > 0, then the ground state energy is zero and 
the graph is g-colorable. If m*(T = 0) = 0, however. 
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the ground state energy is positive and the curve m*{T) 
approaches the origin with a tangent y = m/T. 

The hmit T ^ at fixed ratio m/T corresponds to the 
original zero-temperature solution of the coloring prob- 
lem [12,14] and more generally to the so-called "energetic" 
cavity method introduced in [10]. In the m — T diagrams, 
all curves rn{T) starting at the origin (0, 0) have therefore 
their counterpart in y = dm(T)/d(l/T)|T=o hi the zero 
temperature formalism. It is actually a non-trivial check 
of our numerical results that the different curves m{T) 
we found match perfectly the corresponding slopes y com- 
puted in [12,14] . This shows however that the zero temper- 
ature "energetic" approach [10-12] does not describe cor- 
rectly the thermodynamical states in the colorable phase 
(where m* > 0) . The results of this approach should thus 
be used with caution, and have a clear meaning only in 
the m — T phase diagram. This warning applies in partic- 
ular to the critical values for the dynamical and the IRSB 
stability transitions in [7,11,12,14,23]. A complemen- 
tary "entropic" zero temperature approach was however 
introduced in [15] and allows to obtain more informations 
about the zero energy states [17, 18]. 

Gardner instability. In the mean field spin glass the- 
ory, the IRSB description may be wrong at low temper- 
atures, in which case more steps of RSB are necessary: 
this phenomena is called the Gardner transition [5,24]. 
To test the validity of the IRSB, it is widely considered as 
sufficient to perform a local stability analysis of the IRSB 
approach [7,14,23,25]. Two types of perturbation are to 
be considered. In the first type, one checks if the IRSB 
iterations (5) are stable towards small changes in the site 
dependent distributions P{ip). In the second type, one 
checks if the IRSB iterations (5) are stable against small 
changes in the probabilities t/i themselves. 

The instability of the first type at positive temperature 
is quite problematic to be checked. We used the analytical 
results of [14] for the m,T ^ Q limit with y = m/T fixed 
(see the dotted lines m/ in fig. 1). It is moreover a simple 
algebraic fact that the averages of the IRSB distributions 
P(V') at m = 1 follow the RS equations [17,18]: for = 1 
the IRSB approach is thus type-I unstable for T < Tiocai- 
We conjecture that the contrary is also true, i.e. that 
non-convergence of the distribution P (jjj) a,t m ^ 1 would 
manifest itself as a non-convergence of its mean. 

The instability of the second kind can also be studied 
analytically in the m,T ^ limit [14], and for generic 
(to, T) numerically as follows: one first find the fixed point 
of eq. (5) using the population dynamics method, and then 
compute how small differences in the populations evolve 
in the iteration. This can be done by creating a second 
copy of the population representing the distribution P{ip), 
perturbing infinitesimally every of its elements and check- 
ing if the two populations converged to the same one for 
long times, or equivalently by using the more involved nu- 
merical method developed in [25], which we also used to 
cross-check our results. 



We observed that, at a given temperature, the IRSB 
states corresponding to to > to/ are type I unstable while 
those corresponding to m < mu are type II unstable. In 
order to check the stability, one thus needs to compare 
mi{T) and mii{T) with the thermodynamical m*{T). 
Generically, the instability of the second type is the rele- 
vant one. Some examples are shown in fig. 1: in (a) for 
q = 2, c — A the whole glassy phase is IRSB unstable. In 
(b), q 3, c = 7, the IRSB solution is type II unstable 
for T < Tg and stable for T > Tq- We cannot rule out a 
type I instability, yet we believe this instability unlikely, 
given the slope of mj{T) at the origin. We also imple- 
mented the 2RSB equations and were not able to find any 
non-trivial solutions in the type II stable region. For (c) 
g = 4, c = 11 and (d) q = 5, c = 14 we observed that the 
whole low temperature phase is IRSB stable. 

Overlap distributions. The overlap probability dis- 
tribution function is a useful order parameter in spin 
glasses [2] and allows to characterize the different phases. 
Consider two configurations a and P chosen uniformly at 
random at given temperature. To define their overlap we 
use the matrix Q'^'^ = Y^f^i^ifyf , lj)5{a'^ ,v)/N and an 
example of the definition of an overlap which is invariant 
under permutation of colors in one of the configurations 
is Q = Q^" ■ In the hquid phase, the equihbrium 

distribution of the overlap P{Q) is just a delta function. 
Below the dynamic transition, it is the same, and becomes 
non-trivial only for T < Tk- In this case, the P{Q) is 
made of two peaks, their relative weights are a monotonous 
function of the parameter to*. For m* — > 1 the weight of 
the second peak is near to zero, for to* — > there is only 
one dominating state and the weight of the second peak is 
near to one. For T < Tg the distribution P{Q) is continu- 
ous as in the fully connected Ising spin glass model [2] . At 
zero temperature the distribution P{Q) is nontrivial only 
if < m*(r = 0) < 1 (i.e. in the colorable phase. ^) 

The phase diagram. — We now present our re- 
sults and summarize our findings for the temperature- 
connectivity phase diagrams. We computed the dynami- 
cal Td and Kauzmann Tk temperatures both for regular 
and Erdos-Renyi graphs via the simplification of cq. (5) 
at TO = 1 [16]. The Gardner temperature Tg is computed 
only in the simpler case of regular graphs. 

Ising case: q—2. For the Ising spins, the spin glass 
transition arises continuously at Tiocai ^ Td = Tk given 
by eq. (3). We found that the thermodynamic states given 
by m*{T) are always IRSB unstable as to* < to// (see 
the example in fig. 1(a)). Ising spin glasses should thus be 
described via the infinite replica symmetry breaking for- 
malism as pointed out already in [9]. We also notice that 
both the curves to*(T), m//(T) both goes to zero when 
T — *■ Tjocai' i'^ fully connected model. In the zero 
temperature limit the random graphs are 2-uncolorable in 

^The triviality of P{Q) at zero temperature was predicted in [26] 
but the argumentation in [26] is valid only in the uncolorable phase. 
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Fig. 2: Phase diagrams for the 3-state (left) and 4-state (right) anti-ferromagnetic Potts glass on Erdos-Renyi graphs of average 
degree c (top) and regular graphs of degree c (bottom). For g = 3 the transition is continuous Ta — Tk ~ Tiocai- For q — 4, we 
find that Td > Tk > Tiocai, while for larger connectivities these three temperatures become equal. The Gardner temperature 
To for regular graphs is also shown (green online). In the case of q = 3 and ER graphs, To > only for connectivities larger 
than c > cg = 5.08 [14]. The bold (red online) lines at zero temperature represent the uncolorable connectivities c > Cs. 
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Table 1; Critical temperatures r^;, Tk, Tiocai and Tq for the 
regular graphs ensemble and the q-colorability of the graphs. 
The error bars come from the numerical precision in evaluation 
the solution of (5) by the population dynamics method. 



the spin glass phase, i.e., when Tiocai > (for c > 1 on ER 
graphs and c > 2 on regular graphs [13]). 

The case q=S. The phase diagrams are shown in fig. 2 
(left). We again observe, for both ER and regular graph, a 



continuous transition at Tiocai = T^ = Tk given by eq. (3). 
However, the situation is different from the Ising case. 
Consider for instance the case c = 7, = 3 in fig. 1(b): 
first, m* (Tiocai) = 1 and m// (Tiocai) = 1, and moreover 
the thermodynamical states are type II stable for T > Tq. 
Even if we have not ruled out completely the instability of 
type I, this makes plausible the presence of a continuous 
transition towards a IRSB stable phase, just like in the 
fully connected 3-state Potts model of [5]. 

We found that the Gardner temperature is positive only 
in the uncolorable phase. See table 1 for critical values in 
regular graphs. For ER graphs it was already shown that 
Tq > only for c > 5.08 [14]. The zero temperature 
study [14] also indicates that both instabilities are irrel- 
evant close to the colorable threshold. All this suggests 
that, for colorable connectivities, the whole low tempera- 
ture phase of the 3-state Potts model is IRSB stable. 

The case g > 4. In this generic case we observe the 
same set of transitions as in the mean field theory for the 
ideal glass transition in structural glasses. We plot the 
q = A phase diagram in the right panel of fig. 2. The 
discontinuous dynamical transition Td first arises followed 
by the Kauzmann transition at Tk < Td- The Gardner 
transition Tq < Tk arises again for connectivities larger 
than the colorable thresholds. It is also interesting to no- 
tice that as the connectivity c grows, one actually observes 
that Td, Tk Tiocai (see table 1) so that a situation sim- 
ilar to g = 3 is recovered. This happens however for con- 
nectivities well beyond the coloring transition Cg (since 
Cs (X 2q\ogq while Qocai oc q^.). 

Our results on the IRSB type II stability, and the con- 
jecture that the system is type I stable for T > Tiocai at all 
m < 1, have important implications in the g-coloring prob- 
lem: for q > 4 the colorable phase is always IRSB stable. 
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The expert reader will notice that the conclusions in [14] 
were different and that a unstable region was found, [14] 
however describes the region m, T — > 0, which is not rele- 
vant for the thermodynamical states in the colorable phase. 
While most clusters might be instable, the relevant ones 
are always stable in the colorable phase. 

Discussion. — We studied in this paper a mean field 
Potts glass with anti-ferromagnetic (or disordered) inter- 
actions. We observed a continuous glass transition for 
q = 2,3 and a discontinuous one for g > 4 (at least for low 
enough connectivities). We also considered the stability of 
the IRSB solution and concluded, in particular, that the 
colorable phase at T = is stable for g > 4 and probably 
for q — 3 sls well, thus correcting previous claims [14]. Wc 
expect this conclusion to be also valid for the satisfiability 
problem [23]. It is, however, important to develop a way 
to confirm properly the type I stability for g = 3. 

The phase diagram for q > 4 (right panel of fig. 2) has 
many common characteristics with the one of the finite 
connectivity p-spin model [25,27], whose zero temperature 
limit maps to the XOR-SAT problem [28]. Let us, how- 
ever, state several differences: The satisfiability threshold 
Cs corresponds to the Kauzmann one ck in [25,27], while 
they are different in our model. The temperatures Tk and 
Td are different in the large connectivity limit in [25,27] 
where no local instability exists ^, while Tk and Td con- 
verge to the same value Tiocai > for large connectivities 
in our model. This illustrates the differences (and the 
richness) in the phenomenology of the coloring and satis- 
fiability problems when compared to XOR-SAT. 

Our model is also very similar to the lattice glass model 
[7] where the inverse temperature is replaced by the chem- 
ical potential fi and the energy by the density of particles 
p. The close packing limit studied in [7] however concerns 
only the m = 0, ^ = cx) limit. A quantitative study of the 
phase diagram with the correct value for the dynamical, 
Kauzmann and Gardner transition in this model is thus 
still missing and we are currently working in this direction. 

We see many directions in which this work can be con- 
tinued. First, it would be interesting to consider the large 
connectivity limit for each values of q using the replica 
method, as was done for 3-satisfiability in [29]. It would 
also be of interest to study the dynamics along the line 
of [25]. Monte-Carlo simulations of these models (or ex- 
act ground state enumerations) would also be valuable to 
cross-check the cavity results and to study finite-size ef- 
fects. Finally, the disordered version of our model is a 
good candidate for a glass former in finite dimension. 
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^Note that Tio^al = in the fully connected p-spin, the RS transi- 
tion being first order, and consistently no type I instability is found. 
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